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ABSTRACT 



Each node in a multinode communication system is 
provided with programming to act as a Set Manager for 
a given set of nodes and users. Functions of the Set 
Manager include operation processes for creating distri- 
bution trees for elftcient multicast and bandwidth reser- 
vation tasks. Because set membership is not necessarily 
fixed or accurate at the time the distribution tree is 
created, the Tree Leader task that creates and maintains 
the trees needs accurate and updated information show- 
ing the number of users at the nodes it serves which are 
participating in the distribution tree. The count of ac- 
tive users at nodes served by the Tree Leader is pro- 
vided in response to an indicia established at the time 
the Tree Leader sets up the tree. Each Set Manager at 
a given node monitors for changes in set membership 
and link failure and notifies the requesting Tree Leaders 
for each tree in which it participates whenever changes 
in the number of users either by joining or leaving the 
set or link failures occur by direct communication be* 
tween the Set Managers and the Tree Leaders without 
requiring intervention of other elements in the system. 

7 Claims, 9 Drawing Sheets 
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where Tree Leader and communication Set Leader 

MAINTENANCE OF MESSAGE DISTRIBUTION roles may reside at different nodes, this is facilitated by 
TREES IN A COMMUNICATIONS NETWORK providing direct communication between the node Set 

Managers and an identified Tree Leader for each tree 
RELATED APPLICATIONS 5 having users at a given liode. The Tree Leaders indicate 

This application is related to our own, copending and ««ch node at the time the distribution tree is created 
commonly assigned patent application Ser. No. Tree Leader wishes to receive notifications of 

07/900,647 filed Jun. 18, 1992 which deals specifically various types of changes whenever they occur. An 
with a basic packet switched network comprising multi- indicia code is included in the tree request message 
pie nodes having Set Managers, a network Registrar, described in our aforementioned copending application 
Set Leaders and processes for organizing and control- Ser. No. 07/900,628 which is extended to include an- 
ting the network distributed over each node in the form other field of values for informing the node Set Manag- 
of a Set Manager capable of performing various func- ers as to what notifications the Tree Leader desires to 
tions. The invention is more directly related to our own receive. These can include: informing the Tree Leader 
copending, commonly assigned application 07/900,628 only when users in the subnode leave the set so that the 
filed Jun. 18, 1992 which deals with the message distri- Tree Leader may decrement its user count for the tree 
bution Tree Leader function, the techniques and pro- at the given subnode of the node at which the change 
cesses for controlling the creation of distribution trees occurs, informing whenever a user within a subnode 
and their membership and with the services provided by that is currently on the tree joins the set so that the Tree 
the distribution Tree Leader itself. 20 Leader can mcrement its user count for that subnode or 

FIELD OF THE INVENTION inform when all of the users in a subnode leave the 

set, informing whenever a user in a subnode individu- 
This invention relates to digital communication sys- leaves the set only or informing whenever an indi- 

terns and networks m general and more specifically to vidual user in a subnode joins and/or leaves the set. The 
packet transinission systems used m multicast commum- 25 Manager for the affected node experiencing a 
cauons to a plurality of users where the users may be having been tagged at creation by the Tree 

grouped mto one or more defined subsets managed by deader with an indication that notification is desired 
Tree Leaders. ^1 ^^^^ ^ Change Notification (SCN) to each Tree 

PRIOR ART 3Q Leader having users at the affected node informing the 

r J - * u * !*• J 1*- tree leader or tree leaders of the change in membership 

The use of distnbution trees m muitmode, multmser r r i • * 

data communication networks is fairly well known. A commumcaUons luJc neces^^ to 

class of problem that is faced in such systems includes support one or more u^ in the distnbu^^ 

the functions of maintaining set membership and tree Providmg direct, mdependcnt commu- 

membership when the set is an open set having its own, 35 f^^ation between the Set Manager and the Tree Leader 

independent existence in which users may join and m response to prearranged mdicia descnbmg condm^^^^ 

leave at will, the Set Leader can change. Set Member- ^^^^^ Tree Leader desires to have updated 

ship is variable and the number of trees per set is vari- ^formation, a ^eat deal of topology database query 

able. The Tree Uaders are persistent for the life of each ^^y"s traffic is alleviated entirely and mdepen- 

tree. Supporting the creation and maintenance for mul- 40 ^ent actions to the database may also be avoided, 

tiple trees of this type esUblished among a group of BRIEF DESCRIPTION OF THE DRAWINGS 
packet transport system users in the prior art requires 

constant analysis of the network topology by the tree The foregoing and still other objects of the invention 
managing function and constant reporting by Set Mem- which have not been specifically enumerated are met in 
bers as they join and leave the system. This results in a 45 a preferred embodiment of the invention which is fur- 
very high level of "maintenance traffic" in the network ther described and Ulustt-ated with respect to the draw- 
which occupies an inordinate portion of the bandwidth ings included herewith in which: 
available for communication of traffic itself. FIG. 1 illustrates schematically a multinode network 

having a plurality of network transport system users 

OBJECTS OF THE INVENTION ^ „d wherein the nodes perform various functions as Set 

In Ught of the foregoing known difficulties with mul- Managers, Registrar, Set Leaders and Tree Leaders in 

ticast tree creation and maintenance in a multinode open accordance with our aforementioned copending appli- 

set network, an object of the present invention is to cations and with this invention, 

provide improved means for maintaining a plurality of FIG. 2, comprising FIGS. 2A to 2C, schematically 

message distribution trees in a group of message trans- 55 illustrates a flowchart of the operations conducted by 

port users when the Tree Leader and Set Leader func- the Set Manager at each node in the network whenever 

tions reside in difierent nodes when members join or a transmission system user joins or leaves the set or 

leave the set, or when a link in the distribution tree has when a distribution tree refresh: interval timer expires 

failed. without the Set Manager having received a refresh 

BRIEF SUMMARY OF INVENTION ^ FIG.*3 iUustrates schematically a flowchart of opera- 

Within the context of the multinode packet switched tions conducted by a Set Manager acting as Tree 

communication network of our copending application Leader when it receives a set change notification mes- 

Ser. No. 07/900,647 utilizing the structures for distribu- sage from a node participating in the distribution tree 

tion tree creation and control as shown in our copend- 65 which the Tree Leader manages, 

ing application Ser. No. 07/900,628, the present invcn- FIG. 4, consisting of FIGS. 4A-4D which are joined 

tion provides support and facility for maintaining one or into a continuous flowchart as shown by the labels 

more distribution trees among members in a set of users thereon, schematically illustrates the operations of the 
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Tree Leader in response to the messages received from nodes or their subnodes (cxjnnection points at a node 

the various participating node Set Managers. which serve a given transmission user or group of users, 

*^**o^«,«^,^^T T>nr^T^nT>T^T^ such as those that may be on a local area network, con- 

EMBODIMENT OF PREFERRED INVENTION 5 Leader creates the distribution tree, it specifies its own 

Turning to FIG. 1, several nodes N1-N7 are illus- change set notification requirements to each of the node 

trated in a hypothetical network. The nodes are con- Set Managers that handle the communication between 

nected to one another by physical communication links the links and their attached, supported transmission 

shown by the solid lines interconnecting them and by users. For example, if the Tree Leader wishes to be 

similar communications links or connections to their 10 notified whenever a transport user joins or leaves a 

supported transmission users or terminals TUn as illus- distribution tree, it sets an indicia value comprising two 

trated. As we have previous described in our aforemen- bits within a set membership notification field of the tree 

tioned copending, commonly assigned patent applica- request message which is described in greater detail in 

tions. each node in the preferred embodiment of the our aforementioned copending application. Because the 

invention includes a Set Manager function identified in 15 membership and, indeed, the membership of the 

FIG. 1 as SMfl. A network Registrar having functions distribution tree itself, is not necessarily accurate at the 

of setting up and maintaining set leadership (SLn) is ^he Tree Leader creates the tree, replies to the tree 

designated as arbitrarily residing at node Ni. Three request message show the number and/or identity of 

different communication user groups (trees) have been Members that are currenUy assigned and active at 

artiuarilj^pecified^^^ 20 subnode which is designated as having a user 

(TUs) m FIG 1. These mclude set 1 identified by SLi ^^^^^ ^^^^ distribution Uee is desired. By 

raiding in node Nft which is also acting as Tree Leader ^^^^^ ^^^^^^ participating at 

TL, for the distribution set managed by the Set Leader ^^^'^J^ ^^^^^^ ^.^^^ ^ ^^^^ distribution tree, the 

SLi It IS not necessary that the Tree Leader and Set ^ead^^ ^^^^ ^^^^^ ^1^^ o„ 

Lead^ functions reside m the same node, however, bs 25 ^^^^ ^ ^^^^ ^^^^^^^^ ^ ^^^^ 

willbe pomted out later. A pven rans^^^^^ user such ^ . j ^^^^ bandwidth reserva- 
as TU. may establish (via its SM) a distnbution tree of ^ ^agemem for the tree. The present invention 

Its own amongst a subset of the transmission users lo- . , * ^ ^ ,u ^ r^. ; r t 

cated at various nodes. For example, TU. has estab. Provides a means and a method for mfonmng the Tree 

lished a subset comprised of TU„ TUg, TU5 and TU,i. 30 L^fder of any changes m set membership or of member 

The Set Leader function, which is not directly involved <>f ^^}' ^^^^^^ ^^P]^y^ direct commu- 

with managing or creating the distribution trees may ""^^o" ^^^^^^^^ Mmzgets at the vanous nodes m 
reside elsewhere. It is shown as residing in node N6 accordance with the specified notification requirement 

instead of in the node serving TUx, node N7. Another Tree Leader at the creation of the tree and 



distribution tree has been established by TUy residing at 35 squires no mtervention from the Set Leader which 
node N4 where the Tree Leader TL^resides, but the Set «"de at another node entirely. 

Leader for the set Y is residing in node Nfi. mentioned, the Tree Leader specifies its set or tree 



What has been Ulustrated in FIG. 1 is that various ^^r member notification requirements by setting a noti. 

distribution trees for purposes of communication among ^^^O" ^»eld m each tree request message used m creat- 

specific members of a set of nodes and their supported 40 or extendmg the distnbution tree. The Tree Leader 

transmission users may be created and that each node «>ay request to be informed when transmission users m 

may participate in one or more (or none) distribution a P^en subnode leave the set related to the Uee for 

trees each of which may be managed by a Tree Leader which it is leader. It can also request to be informed 

residing at the same or differem node. A Set Leader for whenever transmission users join the set at a subnode 

the entire set of users or separate Set Leaders for differ- 45 already defined to exist within the tree. Dependmg 

cnt subsets may reside in the same or different nodes "Pon the message bits in the tree request message, the 

also as illustrated. requested type of notification will be known to the Set 

As developed more fully in our aforementioned co- Manager and whenever a given TU leaves or joins the 

pending patent application Ser. No. 07/900,628, the set or physical faUures either in the Set Member or links 

Tree Leader has the main function of creating distribu- 50 of communication occurs, the Set Manger sends a Set 

tion trees based upon set membership that is required by Change NotificaUon (SCN) message to each Tree 

the transmission user, by the bandwidth requirements Leader that manages a portion of a distribution tree in 

specified by the originating user and by the network which the Set Manager is included, informing them of 

topology and link capacities. The creation of a distribu- the change in set membership. Each node Set Manager 

tion tree allows transport users to communicate with a 55 supports the receipt of all possible values of the set 

set or within a set to a given subset of users that they membership notification field and sends the appropriate 

select The present invention describes a distributed Set Change Notification (SCN) message as desired. The 

mechanism and technique that allow a Tree Leader to mechanism for performing this will be described in 

maintain its tree in the face of set membership changes greater detail later. 

and link failures that may occur, but without requiring 60 The set membership notification field from the Tree 

interaction with the Set Leader or with the network Leaders to the Set Managers may comprise two binary 

Registrar function. bits m the tree request messages sent to create or extend 

When a message distribution tree among a subset of a tree. Tree creation or extension is not specifically a 

users is created, it uses a current user set membership as part of the present invention and is therefore not de- 

a starting point. A Tree Leader inquires of the Set 65 scribed in detail. However, a portion of the tree request 

Leader as to what the current set membership is and message comprises a field of at least two bits having 

then creates, with access to the topology database, a possible binary values 00, 01, 10, and 11. The meaning 

distribution tree to the desired Set Members at various of these is arbitrarily assigned in the present invention 
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for informing the Set Manager as to when SCNs are to 
be sent to the Tree Leader. 

The value 00 is assigned the meaning that the Set 
Manager is to inform the Tree Leaders whenever all the 
transmission users at a given subnode leave the set. This 5 
permits the Tree Leader to prune the distribution tree 
and decrement its user count at the subnode for each 
affected tree. 

Code 01 is utilized to inform the Set Manager that the 
Tree Leader is to be notified whenever a user within a 10 
subnode currently on the distribution tree served by a 
Tree Leader joins the set so the Tree Leader can incre- 
ment the transmission user count for that node and 
subnode. It is also used to inform the Set Manager that 
it must send a message whenever all of the transmission 15 
users leave the set at a given subnode. 

The code 10 is used to inform a Set Manager that it is 
to create the SCN and identify whenever an individual 
user at a subnode leaves the distribution tree set. Code 
11 is used to inform the Set Manager that the Tree 20 
Leader is to be informed with an SCN whenever a user 
at a subnode joins or leaves the distribution tree set. 

The Tree Leader is required to trim or prune his 
distribution tree as necessary whenever all transmission 
users at a given subnode have left the set. Whenever a 25 
Set Manager receives a tree request message and the 
specified tree address is found to be valid, the Set Man- 
ager adds the appropriate links and terminal connection 
points which it serves to the distribution tree and re- 
cords the set membership notification value received in 30 
the tree request message so that it may properly notify 
the Tree Leader whenever any changes of the type for 
which notification is desired occur in the set member- 
ship amongst the users that it serves. For each subnode 
(i.e. connection point to a node) the Set Manager serv- 35 
ing the node records the number of transmission users 
included with the tree address for the subnode and these 
values are the transmission user subnode member counts 
for the distribution tree. 

There are several primary reasons why a Tree Leader 40 
would receive notification from a Set Manager includ- 
ing: a user joins the distribution tree or leaves it; a Set 
Manager did not receive the required periodic tree 
refresh signal; and a time out limit has been reached 
which results in the Set Manager disconnecting its tisers 45 
from the tree. A Transmission User TU can be added to 
an existing distribution tree if it happens to reside at a 
subnode already included on the tree without extending 
the tree by further tree creation or tree request messages 
sent by the Tree Leader. 50 

A Tree Leader that is creating a tree for multiparty , 
communication amongst a subset of users can specify in 
its tree request message whether it wishes to be notified 
whenever users within the subnodes at a given node in 
the distribution tree join the set. Thus, whenever a 55 
Transmission User joins the set, the Set Manager must 
check to determine whether the subnode at which the 
Transmission User is connected may be involved in one 
or more distribution trees managed by one or more Tree 
Leaders, respectively. It must then notify the appropri- 60 
ate Tree Leader or Leaders and the terminal Transmis- 
sion User subnode connection has been added to each of 
the affected distribution trees. 

The Set Manager must also check set membership 
notification values and notify as required as noted 65 
above. To do this, it records the TU*s connection point 
(subnode identification) with the tree's address (the tree 
address correlator index as described in our aforemen- 
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tioned application). The Set Manager acting as Tree 
Leader must also increment the user count at the af- 
fected subnode of the given tree and compute a route 
from it to the Tree Leader and send a Set Change Noti- 
fication message with the tree address correlator, the 
Transmission User's node ID and subnode ID together 
with the notification reason such as Transmission User 
"joined", and the Transmission User's count at the af- 
fected subnode on the tree. A message identifier is in- 
cluded to identify the SCN message and inform the 
Tree Leader of what type SCN message it is receiving. 
When a Tree Leader receives the message, it acknowl- 
edges the receipt, but if the acknowledgement is not 
received at the Set Manager who originated the SCN, it 
will resend the message with the same message identi- 
fier. When the Tree Leader fmally receives the SCN, it 
checks the message identifier, resends the acknowledge- 
ment and discards a duplicate message if one should 
occur. The Tree Leader may thus maintain its distribu- 
tion tree whenever set members leave or join the set or 
when a local Set Member fails or when a communica- 
tion link to a member or a node fails since the Set Man- 
ager controlling the Transmission User access notifies 
all associated Tree Leaders that requested notification. 

A Set Manager checks all of the distribution trees 
associated with a user set which a Transmission User 
has left. For each distribution tree, the Set Manager 
performs the following functions. First, it decrements 
the user count for the subnode and tree for each distri- 
bution tree which may be involved. Secondly, it un- 
marks, that is deletes the record of the tree address from 
the TU*s terminal connection point (subnode). Finally, 
the Set Manager will create the Set Change Notification 
message if the notification value it received is 10, 11 or 
if the TU resigning from the set was the last TU at that 
subnode, and it will send the SCN to the Tree Leader 
together with the tree address correlator which identi- 
fies the specific tree, the TU*s node ID and subnode and 
a notification reason, i.e. **TU left set" and a message 
identifier and a TU subnode count for that tree. 

The present invention also accommodates error con- 
ditions such as time out of the tree address by reason of 
a Set Manager not receiving a tree refresh message from 
the Tree Leader for any reason. Whenever a Set Man- 
ager receives a tree refresh message, it resets the tree 
refresh timer to its initial value as described in our afore- 
mentioned copending application. If the timer expires 
without receipt of a tree refresh message, the Set Man- 
ager will delete the tree address from all the trees, links 
and terminal comiection points (subnodes) under its 
control and send the SCN message to the Tree Leader 
with the notification reason that it "did not receive the 
tree refresh message". This is handled at the Tree 
Leader by the Tree Leader process that will be de- 
scribed in greater detail. 

Turning to FIG. 2, the Set Manager acting as Tree 
Leader is indicated in box 1 and it may receive the SCN 
or a tree refresh time out to which it wOl respond in 
accordance with the flow chart comprising the remain- 
der of FIG. 2. 

A set membership notification identifier value is used 
in the tree creation message sent out by the tree leader 
when creating a tree and it determines the condition 
under which the Set Manager at each affected node will 
generate and send the SCN message during the lifetime 
of that tree. A Tree Leader may also receive a specific 
SCN regarding a particiilar failure if a link fails or a TU 
fails or if a timeout occurs when the Set Manager was 
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expecting to receive a tree refresh message as indicated 
above. 

When the Set Manager, 1 in FIG. 2, acting as a Tree 
Leader receives the SCN message, it determines 
whether it is the intended Tree Leader by examining the S 
tree address correlator identification as described in 
greater detail in our aforementioned copending applica- 
tion. This address correlator uniquely identifies the 
specific tree and will be recognized by the Tree Leader 
which created it. If the Set Manager acting as Tree 10 
Leader is not the addressed or intended Tree Leader, it 
ignores the message. However, if it is the intended Tree 
Leader it will perform one of the following actions. 

If the user count at a given subnode on the tree is 
greater than zero and the notification reason received in IS 
the SCN is "user joined" or "user left", the Tree Leader 
will increment or decrement the user count associated 
with a given subnode and tree. If the user subnode 
count for the given tree is equal to zero, and the notifi- 
cation reason is that "user left" and the node and sub- 20 
node IDs happen to be the last elements in a given path 
or branch of the tree, the Tree Leader will prune the 
path by removing the record of the link into that sub- 
node via sending a "tree delete** message in both direc- 
tions on the affected communication link, thereby re- 25 
questing the receiving Set Managers to delete the tree 
address in association with that link. Finally, if the Tree 
Leader determines that the notification reason in the 
SCN is that the Set Manager did not receive a timely 
tree refresh message, the Tree Leader must determine 30 
whether the identified node and subnode is actually 
intended to still be included in the tree. If the identified 
node and subnode should still be included in the tree, 
then the Tree Leader has not intentionally removed the 
subnode and it must reextend the tree to the subnode as 35 
the Set Manager will have deleted the connections. This 
type of condition can be caused by a link failure along 
the path which resulted in failure of the Set Manager to 
receive the tree refresh message initially. Since the Set 
Manager did not receive the refresh message and the 40 
timeout would have occurred, the tree must be recre- 
ated or extended. Similarly, the Set Manager might not 
receive an intended tree discard message and the Tree 
Leader might determine that the affected node and 
subnode are no longer desired on the tree and would so 45 
need take no action. Furthermore, when a Tree Leader 
determines that a disconnected subnode should actually 
be still included in the distribution tree, it may infer that 
all subnodes downstream of the disconnected subnode 
are also disconnected from the tree and it must reextend SO 
the tree to these subnodes as well. 

In FIG. 2, Set Manager 1 receives a positive Join 
Reply, a positive Leave Reply, or an indication that a 
TU has failed as noted above, and proceeds down one 
of several paths in FIG. 2. If a local user joins a set, box SS 

2 is entered where it is determined whether there are 
other distribution trees associated with the group ID of 
the particular user's subnode and if the answer is no, box 

3 returns the process to Box 1 of the set managing pro- 
cess. If the answer is yes, however, box 4 is entered is 60 
and a list of distribution trees including the group ID for 
the transmission user subnode is created. Then box 5 is 
entered where the content of the list is checked to deter- 
mine whether the distribution tree list is empty. If the 
answer is yes, the process returns via box 7 to the Set 65 
Manager 1. If the answer is no, however, the process 
continues to box 6 where the distribution tree set mem- 
bership notification value is checked for a 01 or 11 
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indication. If neither of these is present, box 10 is en- 
tered and the distribution tree is removed from the list 
of trees generated in box 4 and the process continues 
back to box 5 to check any other trees in the list. 

If, however, the set membenhip notification value is 
01 or 11 in box 6, box 8 is entered and the "terminal 
edge", i.e. the subnode connection point within the 
node serving a given TU, is recorded in association with 
the tree address for the distribution tree and block 9 is 
entered. In Block 9, the Set Manager constructs and 
sends an SCN to the Tree Leader with a reason code: 
"user joined" and giving the subnode*s transmission 
user count currently maintained by the Set Manager. 
Then box 10 is entered and this distribution tree is re- 
moved from the list of trees which must be processed 
and notified in accordance with the indication received 
by the Set Manager. 

If a transmission user leaves a given set, Set Manager 
1 enters Block 11 to determine whether there are multi- 
ple distribution trees associated with the group ID of 
the particular transmission user subnode. If the answer 
is no, box 12 returns the process to Set Manager 1. If the 
answer is yes, box 13 is entered which, like box 4, gener- 
ates a list of distribution trees presently associated with 
the group ID of a given transmission user subnode. 
Then Block 14 is entered to determine, as with block 5, 
whether the list of trees is empty and if the answer is 
yes, the process returns via block 15 to the Set Manager 
function. If the answer is no, however, the tree address 
is deleted from the transmission user*s list maintained 
for the subnode connection, i.e. the transmission user's 
terminal edge at the given node as shown in block 16. 

The process then enters block 17 to determine if the 
tree address is recorded for any terminal connection 
point in the subnode. If the answer is no, block 19 is 
entered and the SCN message is constructed and sent to 
the Tree Leader with the reason code transmission user 
left together with the present subnode transmission user 
count. 

If the answer is block 17 is yes, however, block 18 is 
entered to determine whether the distribution tree's 
membership notification value is 10 or 11 and if the 
answer is no, process returns back to block 14 to process 
any other distribution trees in the list. If the answer in 
block 18 is yes, block 19 is entered and the SCN is 
constructed and sent as described. 

If the tree refresh timeout timer expires, without 
having received a refresh message from the Tree 
Leader, then the Set Manager 1 enters block 20 where 
it constructs and sends the SCN message to the Tree 
Leader with a reason code indicating that it "did not 
receive the tree refresh message" and giving the present 
subnode ID affected. It then proceeds to box 21 to 
delete the tree address from the links and terminal con- 
nection points at each subnode that is affected and re- 
turns to the Set Manager process via block 22. 

Turning to FIG. 3, when the Set Manager is acting as 
Tree Leader, it receives Set Change Notification mes- 
sages generated by Set Managers as shown in FIG. 2. 
The SCN message is examined in block 23 to determine 
if the reason code indicates that a user has joined. If the 
answer is yes, the user is added to the internal tree list or 
record maintained by the Tree Leader in block 24 and 
process returns via block 25 to the Tree Leader process 
in block 1. If the answer is no in block 23, block 26 is 
entered to determine if a reason is that the user has left 
If the answer is no, block 31 is entered to determine 
whether the tree should be destroyed and if the answer 



05/02/2003, EAST version: 1.03.0002 



5,289, 

9 

is yeS| the process returns to the Tree Leader via block 
30. But if no, the tree is to be reextended back to the 
subnode and any downstream subnodes as shown in 
block 32. Block 32 enters FIG. 4D at block 105 for 
reextending the distribution tree that has been inadver- 5 
tently truncated. This uses the same process as was 
described with respect to our aforementioned copend- 
ing application Ser. No. 07/900,628. Therefore, FIG. 
4D is a portion of the original FIGS. TA-TD of that 
application. Indeed, FIGS. 4A-4D, but for the renum- 10 
bering on the figures, are same as FIGS. 7A-7D in that 
application. 

If the reason code in block 26 is determined to be that 
a user has left the set, block 27 is entered and the Trans- 
mission User is deleted from the internal hst associated \5 
with the tree and block 28 is entered to determine if the 
count for a given user's subnode is now 0. If the answer 
is no, block 30 returns to the Tree Leader process but if 
the answer is yes, it is necessary to determine whether 
the TU which has left the subnode was the leaf or outer- 20 
most point on a path. This is done in block 29. If the 
answer is no, the Tree Leader process is returned via 
block 30, but if the answer is yes, it is necessary to 
construct and send the tree delete message to delete the 
tree address from the link into the TU's subnode with 25 
the **tree destroy indicia" set to no. This serves as ac- 
knowledgement to the afTected Set Manager at a given 
node and subnode that the user has been deleted from 
the tree. The process then returns via block 34. 

FIGS. 4A-4D are a reproduction of FIGS. 7A-7D in 30 
our aforementioned copending application. That por- 
tion of FIG. 4 shown in 4D beginning at block 105 
describes the process carried out by a Tree Leader 
when the refresh timeout has occurred or a link of the 
tree has failed and is self explanatory. 35 

From the foregoing, it may be easily appreciated that 
many distribution trees associated with a given user set 
cap exist and be maintained without Set Leader's inter- 
vention. This eliminates network control flows of mes- 
sages required when Tree Leaders need to gain knowl- 40 
edge of set membership changes since they are notified 
by the Set Managers from the affected nodes and sub- 
nodes. Secondly, each Tree Leader can defme its own 
particular desired type of set membership notification 
based upon a given user's application requirements. It 45 
eliminates a race condition Uiat may occur when set 
membership changes occur during a time a Tree Leader 
is acquiring new information and the time that the tree 
was originally created and it provides a distributed 
method and apparatus for handling set membership and 50 
communication link failures. 

Having thus described our invention with respect to 
a preferred embodiment thereof and having illustrated 
its preferred implementation in a detailed flowchart, it 
will be apparent to those of skill in the art that the arbi- 55 
trary digital reason codes and the specific order of the 
process steps may be easily modified to accomplish the 
same results by assigning different codes as desired or 
by performing the various requisite process steps in a 
different order without departing from the spirit and 60 
scope of the invention. Therefore, what is desired to be 
protected by letters patent and which is set forth in the 
appended claims is included by way of description only 
and not as of limitation. 

What is claimed is: 65 

1. A communications network having a plurality of 
nodes interconnected to one another by communica- 
tions links via which links messages may be sent and 
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delivered to one or more communication network users 
residing at one or more of said nodes, said network 
being organized for communication among an arbitrary 
group of member of a defined subset of communications 
network users into one or more distribution trees, 
wherein each said node includes means for operating as 
a Distribution Tree Leader for at least one said subset of 
communications network users, said Distribution tree 
Leader including means for generating a distribution 
tree address and a distribution Uee address correlation 
identifier which uniquely identify said distribution tree 
at all said nodes having members of said subset included 
by said Distribution Tree Leader in said distribution 
tree, and means for generating and sending to all said 
nodes having members served by said distribution tree, 
a distribution tree creation request message including a 
Set Change Notification indicator, each said node fur- 
ther comprising: 
means for reporting link, node or user terminal fail- 
ures and changes in distribution tree membership of 
any commimications network user served by said 
node including means for creating and sending on 
said network a network change notification mes- 
sage addressed to each said Distribution Tree 
Leader which requested notification in said tree 
creation request message. 

2. The network as claimed in claim 1, further com- 
prising: 

first means at each node for examining a received said 
network change notification message and for deter- 
mining whether said node is acting as a Distribu- 
tion Tree Leader for the said distribution tree in 
which is located said node which is reporting con- 
ditions via said network change notification mes- 
sage and, second means, responsive to a true deter- 
mination from said first means, for examining net- 
work change notification messages and for deter- 
mining whether a current tree member communi- 
cations network user count for the node which 
generated said network change notification is 
greater than zero and if so, said second means in- 
crementing or decrementing said tree member 
communications network user count at said node in 
accordance with the effect of said network change 
notification. 

3. The network as claimed in claim 1, further includ- 
ing means for identifying any said communications net- 
work users coimected to said node with said distribution 
tree's unique identity. 

4. The network as claimed in claim 2, further includ- 
ing means for identifying any said communications net- 
work users connected to said node with said distribution 
tree's unique identify. 

5. The network as claimed in claim 4, further com- 
prising: 

means, responsive to receipt of a said network change 
notification message containing an indication that a 
said communications network user has left said 
distribution tree and that said user was served by a 
said node which was the last node in a communica- 
tions link, for pruning said distribution tree by 
removing said distribution tree's unique identity. 

6. The network as claimed in any one of claims 1-5, 
further including; 

means, responsive to receipt of said network change 
notification message containing a report that notifi- 
cation is due to failure of a reporting node to re- 
ceive a timely tree refresh message from said Dis- 
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. 1- -T. T J r J . V 7. The network as claimed in claim 6, further includ- 
tnbution Tree Leader, for detenmnmg whether 

said reporting node should still included in siaid means for recreating said distribution tree to include 

^. . J . r J any nodes downstream from the said report node 

distnbution tree and, if true, for recreaung said ^ ^^^^^ j^^j^^^^ ^ ^^^^ 

distribution tree to include said node. ♦ • • • ♦ 
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